Numerical Analysis 


Chapter 4 Interpolation and Approximation 
4.1 Polynomial Interpolation 

Goal Given n + 1 data points 

(x 0 ,y 0 ), (xi,j/i), ••• (x n ,y n ), 

to find the polynomial of degree less than or equal to n that passes through these points. 

Remark There is a unique polynomial of degree less than or equal to n passing through n + 1 given 
points. (Give a proof for n — 2.) 


Linear Interpolation Given two points (xo, Vo) and (aq, y \ ), the linear polynomial passing through the 
two points is the equation of the line passing through the points. One way to write its formula is 

Xi~X X-X 0 

Pi Oo = yo - — — + y i 


X\ — Xq X\— Xq 

Example For the data points (2,3) and (5,7) find P\{x). 


Solution: 


PiM = 3 |-| + 7 |-| = (5 - x) + |(x - 2) 


Example For the data points (0.82,2.270500) and (0.83,2.293319), find Pi(x) and evaluate Pi (0.826). 


Solution: 

Pi (x) 

and hence 


QQ rp rp §2 

2.270500 rv + 2.293319 „„ = 227.0500 (.83 - x) + 229.3319(x - .82) 


.83 - .82 


.83 - .82 


Pi (.826) = 2.2841914. 


Remark. If f(x) = e x , then /(. 82) « 2.270500, /(. 83) « 2.293319, and /(. 826) w 2.2841638. Note then 
that Pi(x) is an approximation of f(x) = e x for x 6 [.82, .83]. 

In general, if y 0 = f(x o) and y\ = f[x i) for some function /, then P\ (x) is a linear approximation of f(x) 
for all x G [x 0 , X\\. 



Quadratic Interpolation If (. xo,yo ), (x±,yi), ( X 2 ,y 2 ), are given data points, then the quadratic 
polynomial passing through these points can be expressed as 

P2(x) = yo L 0 (x) + 2/1 Li(x) + y 2 L 2 (x) 

where 

(x ■- xi)(x - x>) 

0[X) ~ ( Xo - Xl )( Xo -x 2 ) 

(x - x 0 )(x - X 2 ) 

1 X (xi - x 0 )(xi -x 2 ) 

(x - Xq)(x - xi) 

2 X (x 2 - x 0 )(x 2 ~x 1 ) 

The polynomial Ptx) given by the above formula is called Lagrange’s interpolating polynomial and 
the functions Lq, L±, L 2 are called Lagrange’s interpolating basis functions. 

Remark Note that deg(P 2 ) < 2 and that 

Li(Xj) = Sij = | 5 \t] 

Sij is called the Kronecker delta function. 

Example Construct P 2 from the data points (0, —1), (1, —1), (2, 7). 


Solution: 

p 2 m = (- i) ~ 1} 2 (j ~ 2) + (-D 2) + 7 x(x - l) 

Example See Example 4.1.4 on page 122 of the text. 



l)(x — 2) + x(x — 2) + -x(x — 1) 


Higher-Degree Interpolation Given n + 1 data points 

(x 0l y 0 ), (x!,yi), ■■■{x n ,y n ), 
the n Lagrange interpolating polynomial is given by 

P n {x) = yo L 0 (x) + yi Li(x) + y 2 L 2 (x) + y n L n (x) 

where 


L 0 (x) 

(x - xi)(x - x 2 )(x — x 3 ) ■ ■ 

(• X - x n ) 

{xo - xi)(xo - x 2 )(x 0 - x 3 ) ■ 

■ (x 0 - x n ) 

Li(x) 

(x - x 0 )(x - x 2 )(x — x 3 ) ■ ■ 

(• X - X n ) 

(X! - X 0 )(X! - X 2 )(X! - X 3 ) ■ 

■ (Xi - X n ) 

L 2 {x) 

(x — Xq)(x — X\)(x — x 3 ) ■ ■ 

{X ~ X n ) 

{x 2 - x 0 )(x 2 - Xi)(x 2 - x 3 ) ■ 

■ (x 2 ~ X n ) 

L n (x) 

(x — X 0 )(x — Xi)(x — x 2 ) ■ ■ ■ 

(■ X ~ X n -l) 

{x n - Xo)(x n - Xi)(x n -x 3 )-- 

(*^n %n— 



Newton’s Divided Difference Given distinct points Xq and X\ in the domain of a function /, we define 

m = 5 ). 

X\ - X 0 

This is called the first-order divided difference of f(x). 

Remark. Note that if / is differentiable on [xo, xi], then by Mean Value Theorem, there exists a 
c G (x 0 ,xi) such that f[x o,xi] = /'(c). Furthermore, if x)0 and x\ are close to each other, then we have 

f[x o,xi] « f(d) with d = '*° + J ' 1 . 


Example Consider f(x) = cosx, x 0 = 0.2, and x\ = 0.3. Compute f[x o,xi]. 

Solution: 


Note that 


= cos(0.3) - cos(0.2) ^ 247300g 

Jl ’ J 0.3 -0.2 

f ^ Xl ^j = — sin(0.25) w -0.247404 


Definition Higher order divided differences are defined recursively using the lower-order ones. 

Suppose Xo,Xi,X 2 are distinct point in the domain of /. Then the second-order divided difference is 
given by 

f[x i,x 2 \ - f[x 0 ,x l] 


f[x 0 ,X !,X 2 ] = 


x 2 - x 0 


Suppose Xq,Xi, x 2 ,X 3 are distinct points in the domain of /. Then the third-order divided difference is 
given by 

f[x I,x 2 ,x 3 \ - f[x 0 ,x 1,X 2 ] 


f[x o,Xi,X 2 ,X 3 \ = 


x 3 - x 0 


In general, if xq, xi, x 2 ■ ■ ■ x n are distinct points in the domain of /, then the nth-order divided difference 
is given by 

f[x i, x 2 , ■ ■ ■ x n ] - f[x 0 , Xi, c . . . , X n -i] 


f[x 0 ,X i,X 2 ,---Xn = 


X n Xq 


Theorem Suppose xq,xi,x 2 , . . . ,x n are distinct points in [a,b] and suppose / is n times continuously 
differentiable. Then there exists a point c between the smallest and largest of xq, xi, ■ ■ ■ , x n such that 

f(n) 


f[xo,x i, ■■■ ,X n = 


n\ 



Example Let /(x) = cosx, xo = 0.2, x\ = 0.3, X 2 = 0.4. Compute /[xo, ^i, ab- 


solution: From the previous example, we have /[x 0 ,x i] ~ —0.2473009 and 


Thus 


„ r cos(0.4) — cos(0.3) 

fix i,x 2 = — — - « -0.3427550 

’ J 0.4 -0.3 

f[x 0 ,x h x 2 ] = « -0 3427550 - (-0.2473009) ^ ^ 


x 2 — x 0 0.4 — 0.2 

With n — 2 and c = 0.3 ( a point between 0.2 and 0.3) we have 

f'Tc'l 1 

LAd. = __ cos (o.3) « -0.4776682 
which is very close to /[x 0 , xi,X2] as claimed in the theorem. 

Basic Properties of Divided differences 

1) /[x 0 ,xi] = /[xi,x 0 ] and /[x 0 ,xi,x 2 ] = /[xi,x 0 ,x 2 ] = /[xi,x 2 ,x 0 ] = •••. In general if {i 0 , i 2 , 

is a permutation of {0, 1, 2, • • • n}, then 


i in} 


2 ) 


/[x 0 ,x 1 ,X 2 ] = 


/[x 0 ,Xi,---,X„] = f [x j 0 , X h ,--- , X, 

f( x o) , f( x l) 


+ 


+ 


f( x 2) 


(x 0 — Xi)(xi — x 2 ) (xi - x 2 )(xi — X 2 ) (x 2 — X 0 )(x 2 — Xi) 

3) From the definition we have 

fM - f( x 0) 


lim fix o,Xil= lim 
Xl^XQ x-l^xq x\ — x 0 


= f\ x o)- 


The we can define 


/[x 0 ,x 0 ] = /'(x 0 ) 


In general, if Xq = x\ = x 2 = • • • = x„, then 


/[x 0 , x 0 , ■ ■ ■ , x 0 ] = 


/ (n) 


ni 


4) If x 0 = x 2 7^ Xi, then 


/[x 0 ,xi,x 0 ] = /[x 0 ,x 0 ,x 1] = 


/[x 0 ,Xi] - f [x 0 , X 0 ] 


Xi - Xo 



Newton’s Divided Difference Interpolating Polynomial Or Newton’s Form 

Define 

Pi(x) = f(x 0 ) + f[x 0 ,xi\(x - x 0 ) 

P2(x) = f(x Q ) + f[x 0 ,Xi\(x - X Q ) + f[x 0 ,Xi,X 2 \(x— Xi) 

= Pi(x) + f[x 0 ,xi,x 2 ]{x - x Q )(x - Xi) 

P3(x) = f(x o) + f[x 0 ,xi\(x - Xq) + f[x Q,xi,x 2 ](x - Xi) + f[x 0 ,x i,x 2 ,x 3 ](x - x 0 )(x - xi)(x - x 2 ) 
= A(x) + f[x 0 ,x 1 , x 2 ,x 3 ](x - x 0 )(x - Xi)(x - x 2 ) 


P n (x ) = P n -\(x) + /[x 0 ,xi, • • • ,x n -i\(x - x 0 )(x - Xi) ■ ■ ■ (x - X n -i) 

The polynomial P n is called Newton’s divided deference formula for the interpolating polynomial 
or Newton’s form for the interpolating polynomial. Note that P n Od) = f{xi). 

Example Determine the Newton form for the interpolating polynomial for the data set {(—1, 5), (0, 1), (1, 1), ( 
Then use this polynomial to approximate y if x — 1.5. 

Solution 


i 

Xi 

f[Xi] = f{Xi ) 

f[Xi,X i+ 1] f[Xi,X i+ l,X i+2 \ f[x o,X 1 ,X 2 ,X 3 \ 

0 

-1 

5 


1 

0 

1 

-4 

2 

0 1 

2 

1 

1 

5 

10 

3 

2 

11 



Therefore 

P3 (x) = f[xo] + f[x 0 ,xi](x - x 0 ) + f[x 0 ,x !,x 2 ](x - x 0 )(x - Xi) + f[x o,xi,x 2 ,x 3 \(x - x Q )(x - Xi)(x - x 2 ) 

= 5 — 4(x — (-1)) + 2(x - ( — 1)) (x - 0) + 1 (x - (-l))(x - 0)(x - 2) 

= 5 — 4(x + 1) + 2x(x + 1) + x(x + l)(x — 1) 

And so P 3 (1.5) = 4.375. 


4.2 Error in Polynomial Interpolation 


Theorem Let / be a given function on [a, b] and P n be the polynomial of degree less than or equal to 
n interpolating the / at the n+ 1 data points x 0 , xi, X 2 , ■ ■ ■ ,x n in [a, b\: 

P n (x) = f(x 0 ) ■ L 0 (x) + /(xi)-Li(x) + f(x 2 ) ■ L 2 (x) + ••• + f{x n )-L n (x). 

If / has n + 1 continuous derivatives and x 3 are distinct, then 

_ P4x) = (.-.»)n-x 1 )...n-x„) / ,„ +1 , 

(n + 1)! 

where a < x < b and is between the maximum and minimum of a:, xq, x\ , xq, • • • , x n . 

Example Let /(x) = e x on [0, 1] and let 0 < x$ < x\ < 1. Then by the theorem, 

where 0 < x < 1 and is between the maximum and minimum of x, xq, and x\. If we assume that x$ < x < x\, 
then c x is between xq and xi, and we have 

< |/w _ Pi(l) | < 


Note that if h = xi — xq, then 


and hence 


max 

Xq<X<Xi 


(x — Xq)(xi — x) h 2 


1 .. . , , (x — x 0 )(xi — x) _ h 2 

l/W - ^ ^ < -e. 

In particular, if x 0 = 0.82, xi = 0.83 and if x = 0.826, then the above reduces to 

\e x — Pi(x)| < 0.000340 

Note that the actual error is —0.0000276. 


Example Let /(x) = e x on [ 0 , 1 ] and let O<X0<X1<X2<L Then by the theorem, 

/W - P,( X ) = h-^hx£l)hx£!) e c. 

6 

where 0 < x < 1 and is between the maximum and minimum of x, Xo, xi, and x 2 - If we assume that 
xq < x < x 2 and that h = x 1 — xq = x 2 — x\, then c x is between xq and x 2 , and we have 


|/(x) -P 2 (x)| < 


(x — Xo)(xi — x)(x — X2) 


e X2 < 


(x — Xo)(xi — x)(x — x 2 ) 


Note that for h — x\ — xq — x 2 — x\, we have 


max 

XQ<X<X2 


(x — xq)(xi — x) h 3 


Thus, 


I/O) - AO) | < w 0.174/r 3 . 


In particular, if h = 0.01 then the above reduces to 

\e x — P 2 (x) | < 1.74 • 10 -7 



4.3 Interpolation Using Splines 


Remark Consider the data points (0, 2.5), (1, 0.5), (2, 0.5), (2.5, 1.5), (3, 1.5), (3.5, 1.125), (4, 0). 
The iterating polynomial of Newton and Lagrange are of degree 6. Figure 4.8 on page 148 shows the graph of 
(a;). Such polynomials are not always easy to evaluate and there may be loss of significant digits involved in 
their calculations . 

For these reasons it is desirable to consider piecewise polynomial interpolation. This involves finding 
a continuous function g on [0,4] and that is a polynomial of ’small’ degree in each of the intervals [0, 1], [1,2], 
[2,2.5], [2.5,3], [3,3.5, and [3.5,4], Clearly we need g to interpolate the data set. 

Such a function g is called a piecewise linear interpolation if each of the polynomials on the subintervals 
are of degree less than or equal to 1. 

We say g is a piecewise quadratic interpolation if each of the polynomials on the subintervals are of 
degree less than or equal to 2. 

Example For a piecewise linear interpolation of the above data points, see Figure 4.7 on page 147 
of your text. Figure 4.9 at the bottom of page 148 shows a piecewise quadratic interpolation. 

Remark Both the linear and the quadratic interpolating functions are inadequate in that the function 
g is not differentiable at the node points. Thus if smoothness at the node points is required we need the 
degree of the polynomials to be at least less than or equal to three. As the following theorem states this is all 
we need. 

Theorem If a — X\ < x 2 < ■ ■ ■ x n -i < x n = b, then there is a unique interpolating function s(x) of the 
data points ( x i, yi), (x 2 ,y 2 ), •• •, {x n , Un) such that 

51 s(x) is a polynomial of degree < 3 on each of the subintervals [xj_i, x^ for i = 2, 3, • • • n. 

52 s(a;), s'(x), and s"(a;) are all continuous on [a,b] 

53 s"(a;i) = s"{x n ) = 0 

The function s satisfying the above theorem is called the natural cubic spline 
Construction of the natural cubic spline s(a:) 

To simplify notation, we assume that 

b — a 

h = x 2 - x 1 = x 3 - x 2 = ■ ■ ■ = x n - x n -i = . 

n 

Note that s"(x) is at most linear (why?). Define 

Mj = s"( Xj ). 

Then, since s"(xj- 1 ) = Mj_ 1 and s"(xj) = Mj are points on the linear function s"(x ) and since s"(x) is the 
equation of the line passing through the points (xj-i, Mj_i) and ( Xj,Mj ), we can write its equation as 

„ , , Mj_i . Mj . 

s (x) = ^ (Xj - x) + -J^\ x - x j- 1 ) 



We now integrate s"(x) twice and use the continuity of s' and s, and the fact that s(xi) = y % to obtain 


Mj - 1 . ... M it , yi- 1, y-j . . hMj_i , hMj , , 

sm = — (x,- - x) +— (x-Xj-i) H —{x j —x) + —(x-x j _ i) — (Xj - x) — 


6 h v J ' 6/z v " h K J ' /W" ^ / 6 

For a general formula we can replace h by Xj — Xj - (See text on page 150.) 


The Mj are obtained from the following n — 2 equation 

h , , 2h , r h 1 1 — yj y 1 — u,_i 
—Mj_i H Mj + - = ^ ^ 

6 J 3 J 6 h h 

and the two conditions form S3 of the theorem, which in this case translate to 


M 1 = 0, 


M n = 0 


Example 

Solution: 


Since M\ = 


For the data points (1, 1), (2, 1/2), (3, 1/3), (4, 1/4), find the natural cubic spline. 
Here n — 4 and h — 1. The last system of equation is then 


+ |m 2 

+ 


= 

1 

3 

|m 2 

+ 

W 3 + 

IM 4 = 

1 

12 

0, the above reduces to 





\m 2 

+ 

1^3 = 

1 

3 


\M 2 

+ 

iM 3 = 

1 

12 



Solving this we get M 2 = 1/2 and M 3 = 0 

Substituting Mi = M 3 = M 4 = 0, M 2 = 1/2 and y\ — 1, ; y 2 — 1/2, y 3 = 1/3, i/ 4 = 1/4 in the formula for 
s(x) and simplifying we get 


s(x) 


1 t 3 l. r 2 1„ | 1 

12 ^ 4 X 3 ^3’ 


1^™3 3 , r 2 7 I 17 

12 4 3 “ r 6 ’ 


12"° ~ 12’ 


1 < x < 2 

2 < x < 3 

3 < x < 4. 



